METHOD FOR LOST PACKET RECONSTRUCTION AND DEVICE FOR 

CARRYING 

The present invention concerns error correction when sending 
digital data in the form of packets. 

When sending digital data over a network in the form of data 
packets, the packets may be affected by transmission errors. Networks 
enabling the transfer of digital data in the forni of packets have particular 
characteristics, such as bandwidth, latency or reliability, that vary from one 
type of network to another. Depending on the type of network, different levels 
of sensitivity* can be observed for different types of errors likely to occur 
during data transmission by packet over this network. The types of errors 
likely to arise include the transmission of a packet with an erroneous bit, the 
random loss of a packet, the loss of a sequence of adjacent packets, the 
duplication of a packet or of a sequence of packets. 

Traditionally, there are two types of method for addressing these 
errors. First, there are the error detection methods for detecting that a 
transmitted packet is in error and for ignoring it. Generally these methods are 
used when the transmission protocol has the facility to request that the lost 
packet be resent. Examples of such methods include the ORG (Cyclic 
Redundancy Check) method and the TCP (Transmission Control Protocol) 
protocol on IP networi<s. Secondly, there are methods enabling not only the 
detection of an erroneous packet, but also its reconstruction. These methods 
are known under the acronym FEC (Fonward Error Correction) and are well 
suited to protocols in which it is not possible to request that an erroneous 
data packet be resent. An example of the use of such methods occurs In the 
case of protocols for transmitting multimedia content in real time, where 
meeting the real-time requirement is incompatible with resending erroneous 
packets. The RTP (Real Time Protocol) protocol is an example of such a 
case. 
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The general principle of operation of FEC methods is applying a 
function, for example an XOR, to a group of data packets. The result of this 
function produces a packet, called a correction packet, which is transmitted 
in addition to the data packets used to generate it. When a packet is 
5 detected as being in error, the correction packet, associated with the 
correctly transmitted packets, enables the erroneous packet to be 
reconstructed. However, this method has its limitations in that there are 
some errors that cannot be corrected. Specifically, if there are two erroneous 
packets in the group of packets used to generate a correction packet via the 

10 XOR function, that correction packet may not be sufficient to reconstruct the 
two erroneous packets. The strategy adopted in choosing packets for 
generating the correction packet is therefore crucial to the effectiveness of 
the correction method. In particular, this strategy will depend on the type of 
errors occurring most frequently on the type of network used. For example, 

15 computing the correction function on N adjoining packets will result in 
correcting random errors that are few in number, but will be ineffective on a 
series of lost packets. To address series of lost packets, a known approach, 
as documented for example in the Pro-MPEG forum's "Code of Practice", is 
to compute the correction function on a group of D packets taken periodically 

20 every L packets. The function is applied to packets i, i+L, i+2L, ... , i+(D-1)L. 
In this way, a series of erroneous packets, of at most L adjoining packets, 
may be corrected by the method. 

The problem with this method is that, although very well suited to 
25 series of erroneous packets, it tums out to have a statistical rate of success 
that decreases very rapidly as the rate of random errors increases. The need 
is therefore apparent of a method that better withstands an increase in the 
rate of random errors while maintaining good correction performance for 
series of data packets. 

30 

The aim of the invention is therefore to propose such a method. It 
consists in applying the correction function to D packets as described above 
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but also in applying it to L packets numbered i, i+2, i+ L-1. In this 
way, each data packet is used to compute two correction packets, and the 
correction rate in the presence of random errors increases significantly while 
maintaining good correction performance for series of data packets. 

5 

The invention concerns a method for securing a data packet 
stream involving the following steps: arranging the packets to be sent in a 
matrix of D rows and L columns; to each row and each column of the matrix, 
applying an error correction function, the result of which is a correction 
10 packet; then sending the resulting correction packets in addition to the data 
packets. 

According to another aspect of the invention, the correction 
function is also applied to the row formed by correction packets resulting 
15 from the application of the correction function to each column of the matrix 
generating an additional correction packet. 

According to another aspect of the invention, the correction 
function is also applied to the column formed by correction packets resulting 
20 from the application of the correction function to each row of the matrix 
generating an additional correction packet. 

According to another aspect of the invention, the headers of the 
correction packets contain a field for distinguishing whether they have been 
25 computed on a row or a column of the matrix. 

According to another aspect of the invention, the correction 
packets are transmitted in the same stream as the data packets. 

30 According to another aspect of the invention, the correction 

packets are transmitted in a different stream from the one conveying the data 
packets. 
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The invention also concerns a method for reconstructing lost 
packets in a data packet stream involving the following steps: arranging the 
received packets in a matrix of D rows and L columns, taking their sequence 
5 number into account; to each row and each column of the matrix containing 
at least one lost packet, applying a function for reconstructing missing 
packets using the received packets and the correction packet corresponding 
to the row or to the column. 

10 According to another aspect of the invention, the reconstruction 

function can also be applied to a row or a column of correction packets using 
an additional correction packet generated for this purpose. 

The invention also concerns a transmitter device for transmitting a 
15 data packet stream over a network containing computation means 
generating a correction packet by applying a correction function to a group of 
data packets and characterized in that the device contains means for 
applying this function to the rows and to the columns of a matrix formed by 
data packets. 

20 

According to another aspect of the invention, the means applying 
the function do so according to the method disclosed in the patent. 

The invention also concerns a receiver device for receiving a data 
25 packet stream over a network containing means for computing lost packets 
as a function of the data packets and correction packets received, 
characterized in that the device has means for applying these computation 
means to the rows and to the columns of a matrix of data packets of the 
stream and to the correction packets corresponding to these rows and these 
30 columns. 
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According to another aspect of the invention, the correction 
packets are generated according to one of the methods disclosed in the 
patent. 

5 The invention will be better understood, and other features and 

advantages will become apparent, on reading the following description which 
makes reference to the accompanying drawings in which: 

Figure 1 is a block-diagram representation of the application of the 
correction function to data packets. 
10 Figure 2 represents the structure of a correction packet placed in 

a packet according to the RTP protocol. 

Figure 3 represents the header of a correction packet according to 

RFC 2733. 

Figure 4 represents the header of a correction packet according to 
15 the example implementation of the invention described. 

Figure 5 represents the hardware architecture of a transmitter or 
receiver device according to the example implementation of the invention. 

Figure 6 represents the steps of the method for the transmitter. 
Figure 7 represents the steps of the method for the receiver. 

20 

Figure 5 represents the internal architecture of a transmitter or 
receiver device 1 which contains ROM (Read-Only Memory) 4 enabling it to 
store programs and data, and RAM (Random Access Memory) 3 enabling it 
to load these programs in preparation for an execution by the processor 2. 
25 This device is connected to an IP network via a network interface 5 which 
means that it can transmit or receive the streams. These components 
communicate via an internal bus 6. 

The example implementation of the invention is in the context of 
30 digital data transfer in real time over an IP network. The data is transmitted, 
in this example implementation, in the form of a stream via the RTP (Real 
Time Protocol) protocol. As already mentioned, RFC 2733 describes a 
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Standard way to correct data packets transmitted by the RTP protocol. This 
method was the subject of an extension described in the Pro-MPEG forum's 
"Code of Practice" document. The example implementation of the invention 
which will now be described is an improvement that is compatible with this 
method. 

In this example implementation, the data packets are separated 
into groups of L*D packets. They are then arranged in a matrix of D rows and 
L columns, as Figure 1 shows. L and D are chosen according to the 
effectiveness desired. The way in which these parameters affect the 
effectiveness of the correction method will be described later. A correction 
function is then applied to each column of the matrix; the same correction 
function is also applied to each row of the matrix. This correction function 
can be an XOR, which would be the simplest to implement, but other 
functions are also possible such as the Reed-Solomon function or a 
Hamming code. These functions are more powerful but more costly in terms 
of computation. Whichever correction function is chosen, the result of 
applying this function to a group of packets, in this case a row or a column of 
the matrix, is a packet referred to as the correction packet. The method 
therefore results in L correction packets corresponding to the application of 
the function to each column and D correction packets corresponding to the 
application of the function to each row. It is also possible to add a correction 
packet computed by applying the correction function to the correction 
packets themselves, thus adding a second level of protection for correcting a 
loss of a correction packet. 

These packets must be transmitted to the data stream. This 
transmission can be performed in several ways. The correction packets can 
be transmitted in the same stream as the data packets, but they are then 
subject to the same transmission risks as the stream they are protecting. 
They can also be transmitted in a separate stream, thus increasing the 
resistance to errors. 
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The method described by the Pro-MPEG forum consists in 
computing and sending the correction packets computed from the columns 
of the matrix. The method disclosed in the patent, insofar as it sends these 
5 same packets, remains compatible with the Pro-MPEG method. This is 
because receiver devices according to this standard will ignore the correction 
packets computed on the rows of the matrix and will therefore be able to 
operate in the same way with a transmitter according to the invention and 
with a transmitter according to the Pro-MPEG method. 

10 

The structure of a packet, as described in the RFC, is represented 
in Figure 2. It consists of an RTP packet header, a description of which can 
be found in RFC 1889. This header is followed by an FEC header and then 
the actual correction packet. The structure of an FEC header according to 

15 RFC 2733 is represented in Figure 3. This header contains an SN base field 
which contains the lowest sequence number of the group of data packets 
used to construct the correction packet. The Length recovery field is used to 
determine the length of any data packet. It is constructed by applying the 
correction function to the group formed by the lengths of each data packet. 

20 The E field is used to Indicate an extension to the header. The PT recovery 
field is obtained by applying the correction function to the data packet Type 
field. The Mask field is a 24-bit field for determining which data packets are 
used to construct the correction packet. If bit i is at 1, this means that 
packets N + i are used to construct the correction packet. N is the base 

25 stored in the SN base field. The TS recovery field is computed by applying 
the correction function to the timestamps of the data packets. It is used to 
reconstruct these timestamps. 

It is observed that through this mechanism, correction packets can 
30 only be computed on groups of a maximum of 24 data packets. To exceed 
this limit, an extension to this header is defined in the Pro-MPEG forum's 
"Code of Practice" document. This extension is represented in Figure 4, 
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which shows the same header as previously, with the extension field set to 1 . 
A new 2-bit extension field, E, is added which determines the use of the 
"Extension field" field. The Type field indicates which correction function is 
used: 0 for XOR, 1 for a Hamming code, 2 for a Reed-Solomon function. The 
5 Index field is used to order the FEC packets in the event that the result of the 
correction function exceeds the maximum size of a packet. This can be the 
case for complex correction functions. The Offset field determines the period 
chosen to select the data packets; it corresponds to the parameter L of the 
matrix. The NA (Number of Associated) field detennlnes the number of 
10 associated data packets for the generation of the correction packet; this 
number corresponds to the parameter D of the matrix. The "Extension field" 
field is reserved for future use. The Mask field has become useless and is 
initialized by filling bytes having a value of 0. 

15 The modification brought about by the invention consists in 

separating the 2-bit E field into a new 1-bit E' field and a 1-bit D field which 
determines whether the correction packet in question is computed on the 
columns, in which case this D field is set to 0. If the correction packet is 
computed on a row, this D field is set to 1 . It is observed that through this 

20 mechanism, a correction packet computed on a column remains completely 
identical to the same packet computed according to the Pro-MPEG forum 
method, while the additional packets computed on the rows can be identified 
by the presence of the D field set to 1 , which amounts to setting to 1 the 2-bit 
extension field, E, if the packet is interpreted according to the Pro-MPEG 

25 method indicating that this packet is using an extension in the format defined 
by the forum. 

When packets are being received, the receiver will store the 
received packets in a buffer. The size of this buffer must be such that it can 
30 store at least L*D data packets and the L+D corresponding correction 
packets. The distinction between the data packets and the correction 
packets is made by the Type field of the RTP header as described in RFC 
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1889 that describes this protocol. It will be possible to identify the data 
packets among them through their sequence number and the correction 
packets among them through the SN base field of their header. Knowledge 
of the missing packets will then enable an attempt to be made to reconstruct 
5 them by using the correction function and the correction packets. For 
example, if the correction function used is the XOR function, it is possible to 
correct the loss of one data packet in a group of data packets used to 
generate a correction packet, using this correction packet. There will 
therefore be identified in the matrix of received packets, the rows and 
10 columns containing only one lost packet in order to reconstruct them with the 
corresponding correction packet. The correction can, for example, be carried 
out using the following method: 

Computation of a vector NLi of the number of missing data 

packets in row i. 

15 - Computation of a vector NCi of the number of missing data 



packets in column i. 
- While there remains a missing packet in the matrix: 
o Find the minimum index p such that NLp = 1 ; 
■ If such a p exists: 



20 



• Find the column index q corresponding to the 
missing packet 



25 



• Reconstruct the missing packet of index p and q by 
applying the XOR function to the other packets of 
the row and to the correction packet corresponding 
to this row 



30 



• NLp = 0; NCq = NCq-1; 

In the absence of such an index p find a minimum index q 
such that NCq = 1 

• If such a q exists: 

o Find the column index p corresponding to 
the missing packet 
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o Reconstruct the missing packet of index p 
and q by applying the XOR function to the 
other packets of the row and to the 
correction packet corresponding to this 
5 column 

o NLp = NLp-1; NCq = 0; 
• Else, the reconstruction method has failed. 



In the event of success, all the lost packets are reconstructed. 

10 

Parameters L and D of the method must be chosen with 
consideration to the following information. First, the overhead generated by 
the correction packets which must be sent in addition to the data packets is 
1/L+1/D; therefore choosing large values for L and D will minimize 

15 occupation of the bandwidth required for the use of the method. 
Furthermore, the method can be used to correct series of lost packets of at 
most L+1 adjoining packets, so the larger L will be, the more effective the 
method will be in correcting this type of error. The method is capable of 
correcting all random packet losses up to three lost packets and certain 

20 random packet losses up to D+L-1 lost packets. The symmetry of the 
problem leads to a maximum effectiveness on the random packet losses 
when L and D have the same value. Now, the method requires buffers in 
both the receiver and transmitter devices, having a minimum size of L*D 
packets. It is therefore observed that choosing large values for L and D is 

25 beneficial to maximize the effectiveness of the method but the choice is 
restricted by the size of the transmit and receive buffers of the devices. 
Another limitation can arise from the correction function computation time 
which can become long for a large number of packets and if a complex 
function is chosen. 

30 

Statistical calculations can be used to compare the effectiveness 
of the method with that described by the Pro-MPEG forum. As expected, its 
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effectiveness is observed to be markedly increased. For example, by using 
the XOR correction function and a matrix in which L and D have a value of 6, 
the method corrects 94.1 per cent of random losses of 6 data packets while 
the RFC method corrects only 2.4 per cent. The method therefore turns out 
5 to be much more effective in correcting random losses of data packets in the 
stream. The method is capable of correcting all losses of adjacent packets 
up to D+1 successive packets where the Pro-MPEG method corrects only up 
to D successive packets. It is therefore observed that the performance on the 
loss of adjacent data packets is slightly improved while the performance on 
1 0 random errors is greatly increased. 



It is clear, for the person skilled in the art, that the example 
implementation described here is not limiting. In particular, the invention can 
be used in the context of all protocols for transferring data by packets and 
15 not only in the context of RTP. It is also possible to use any correction 
function; the invention is not limited to the correction functions mentioned in 
the patent. 



